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ABSTRACT 



A comparison of faculty and student evaluation of an 
instructor- rating questionnaire at Northampton County Area Community 
College, Pennsylvania, is the subject of this reportl Students and 
faculty members were asked to specify the relative importance of 12 
given areas considered in instructor evaluation, and then to suggest 
scores between 10 and zero for both a theoretically excellent and 
poor teacher in each of the 12 areas. The comparison of responses 
suggests that: a highly positive correlation exists between each 
group's rating of the areas: the areas are not considered as having 
equal importance; and the mean ratings of students indicating scores 
for the excellent and poor teacher in each area were consistently 
higher than those given by the faculty. [Not available in hard copy 
due to marginal legibility of original document. ] (JO) 
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NORTHAMPTON .COUNTY AREA COMMUNITY COLLEGE 



Report on Faculty and Student Evaluation of Instructor Rating Questionnaire 



by John G. Krupka 
March 1970 



Faculty and students at Northampton County Area Community College participated 
in the evaluation of an Instructor Rating Questionnaire (IRQ). This report compares 
the way the faculty and students rated the twelve areas of the IRQ and the scores 
that they thought represented good and poor rating for each area. A copy of the 
questionnaire is appended. 

One hundred and sixty students, selected systematically from the total list 
of students by the Office of Instruction, were sent the IRQ. Sixty returned and 
valid questionnaires represent the students' evaluation. 

The first area of concern was whether or not the faculty and students felt that 
the twelve rating areas were equivalent, i.e., that each one is equal in importance 
in judging a teacher. Both groups were asked to rank the twelve areas from 1 to 
12, from most important to least important. If each area was equivalent one would 
expect a mean rating of 6.50 for each area. 







o 



o 




The following are the twelve rating areas: 

1. Instructor's Knowledge of Subject 
11. Organization of Course 
111. Assignments 

IV. Ability to Arcuse Interest-Skill in Guiding the Learning Process 
V. Classroom Presentation 
VI . Mannerisms 
Vll. Grading 

Vlll. Willingness to Help 
IX. Speech and Enunciation 
X. Use of Language 
Xl. General Estimate of Teacher 
Xll. General Estimate of the Course 

The mean ratings and their standard deviations were computed for both groups • 
Standard deviation is a measure of central tendency. The smaller the S.D., the 

more numbers center around the mean. The following table compares the ratings of 
the two groups. 




- 2 - 



Distribution of Mean Ratings of the Twelve Areas of the IRQ by Facultv and 
Students (*) 



AREA 



FACULTY 



STUDENTS 



mean S. D. 



mean S. D. 



I 

' II 
III 
IV 
V 
VI 
VII 
VIII 

IX 

X 
XI 

XII 



2.93 


2.37 


(1) 


4.12 


2.44 


(4) 


5.74 


2.42 


(5) 


3.51 


2.67 


(2) 


4.00 


2.31 


(3) 


8.11 


3.23 


(8) 


7.35 


2.45 


(7) 


6.11 


2.63 


(6) 


8.35 


1.95 


(9) 


8.46 


2.23 


(10) 


8.86 


3.21 


(11) 


10.40 


2.39 


(12) 



2.27 

3.56 
7.90 
2.67 

4.25 
8.97 

7.57 

5.25 
8.37 
8.50 
9.30 

9.57 



1.53 (1) 

1.41 (3) 

2.36 (7) 

1.85 (2) 

2.31 (4) 

2.24 (10) 
2.51 (6) 

2.06 (5) 

2.08 (8) 
1.20 (9) 

3.19 (11) 
3.16 (12) 



(*) The nurn bers in parentheses represent the ranking of the area. For 

example, both the faculty and the students rank areas I and IV as first 
and second in importance in the judgment of a teacher. 

The rank-difference coefficient of correlation was computed between the 
rankings of the two groups and this Is equal to 0.95. The interpretation is 
that there exists a very strong positive relationship between the way faculty 
judge these areas and the way students judge these areas. 

Using the theoretical mean rating (6.50) as a point of division of those 
areas that are most important and least important, the areas judged most im- 
portant by each group are: 



Important Areas in the Evaluation of a Teacher 
faculty Students 



(1) Instru. Know, of Subject 

(2) Ability to Arouse Interest 

(3) Classroom presentation 

(4) Organization of Course 

(5) Assignments 

(6) Willingness to Help 

In a comparison of the standard 
that the students are more 



(1) Instru. Know, of Subject 

(2) Ability to Arouse Interest 
' (3) Organization of Course 

. (4) Classroom presentation 
(5) Willingness to Help 



group it can be seen 



deviation of each 
homogeneous in their thinking. 




-3- 



Concl us ions: 

(1) that both faculty and students feel that the twelve areas are 
not equivalent. 

(2) that the faculty and the students rate the areas in a highly 
positive correlated manner. 

The second area of concern is what scores reflect excellent and poor ratings 
of an instructor in each of the twelve areas. The students were asked to give 
a score, from 10 to 0, for a theoretical excellent teacher and theoretical poor 
teacher for each of the twelve areas. The following table compares the ratings 
of the two groups. 



Facj I ty-Student Theoretical Ratings 



Facu I ty 

E P 



Area 


mean 


S. D. 


mean 


1 


8.23 


0.88 


2.58 


II 


8.02 


1.12 


2.60 


III 


7.47 


1.45 


2.32 


IV 


7.61 


1.53 


2.07 


V 


7.53 


1.28 


2.23 


VI 


6.88 


i .64 


2.28 


VII 


7.51 


1.68 


2.44 


VII! 


7.65 


1.43 


2.18 


IX 


7.11 


1.38 


2.07 


X 


7.02 


1.47 


2.04 


X! 


7.33 


1.79 


2.02 


XII 


6.49 


2.48 


1 .65 



Student 

E P 



S. D. 


mean 


S. D. 


mean 


S. D, 


1.29 


9.25 


0.77 


3.48 


2.28 


1.27 


8.45 


1.11 


3.20 


1.96 


1.18 


7.85 


1.36 


3.03 


2.06 


1.46 


9.27 


1.07 


2.65 


1.88 


1.13 


8.63 


1.02 


3.28 


1.59 


1.34 


7.77 


1.45 


3.18 


2.20 


1.59 


8.55 


1.24 


3.37 


1.93 


1.14 


9.35 


0.86 


3.23 


2.31 


0.95 


8.15 


1.26 


3.52 


2.28 


1.02 


8.27 


1.18 


3.53 


2.08 


1.09 


8.68 


1.26 


2.97 


1.80 


1.20 


8.57 


1.21 


3.27 


2.08 



The first thing that should be noted in the table is the consistent manner 
in which the faculty*s rating of an excellent teacher is less than that of the 
students rating*This difference in mean ratings for the theoretical excellent 
teacher is significant at the .001 level. This difference could be caused by 
the "self -protect ion" effect. The faculty also feel that a poor teacher would 
be indicated by a lower score than that indicated by the students. 

If all areas are rated equally, as they are now, the grand mean ratings 
for each category for each group i s : - 



Grand Mean Rating s 



Facu I ty 

Excel lent Poor 



Student 

Excellent Poor 



Mean 

S.D. 



7.40 

1.51 



2.21 

1.22 



8.57 

1.15 



3.23 

2.04 
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Using the students ratings for each area, and assuming these ratings of 
a theoretical teacher reflect the ratings these students would in fact make 
for a real live excellent instructor, then area norms can be established. 

These norm ranges will be established using the following method: for Area I 
the mean and standard dev i at ion -of the students rating for an excellent teacher 
are 9.25 and 0.77 respectively. A range of 9.25 1 0.77 would represent the 
range in which most excellent teacher ratings would fall. A teacher receiving 
a rating below 9.25 - 0.77 = 8.48 would be judged not an excellent teacher. 

A teacher receiving a rating above mean + S. D. would real ly be an exceptional ly 
excellent teacher. This same procedure will be used to determine area norma- 
tive ranges for a poor teacher. 

Normative Student Ratings of An Excellent Teacher 

Normative Range 

8.48 - 10.00 
7.34 - 9.56 

6.49 - 9.21 
8.20 - 10.00 
7.61 - 9.65 
6.32 - 9.22 
7.31 - 9.79 

8.49 - 10.00 

6.89 - 9.41 
7.09 - 9.45 
7.42 - 9.94 
7.36 - 9.78 
7.42 - 9.67 : 



Normative Student Ratings of a Poor Teacher 
Area Normative Range 

5.76 - I .20 
5.16 - 1.24 
5.09 - 0.97 

4.53 - 0.77 
4.87 - 1.69 
5.38 - 0.98 
5.30 - 1.44 

5.54 - 0.92 
5.80 - I .24 
5.61 - 1.45 

4.77 - 1.17 
5.35 - 1.19 
5.26 - 1.19 



ERIC 



II 

III 

IV 

V 

VI 

VII 

VIII 

IX 

X 
XI 

XI I 

Grand Mean 



Area 



III 

IV 

V 

V! 

' VII 
Vi I I 

IX 

X 
XI 

XI I 

Grand Mean 



The third area of concern of this study was student opinion of the 
IRQ. When the students were surveyed they were asked to comment on the 
rating questionnaire, was it good, bad, were there areas to delete or add. 
It -seemed, to this researcher, that most of the students took advantage of 
this opportunity. The Instruction Office has recorded these comments. 

Final Conclusions and liftpl i cat ions: 



1. The scoring and evaluation of the ratings of the IRQ should be changed. 

2. The actual ratings should be compared with these theoretical ratings. 
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Questionnaire Code Number 



NORTHAMPTON COUNTY AREA COMMUNITY COLLEGE 
INSTRUCTOR RATING QUESTIONNAIRE 
PURPOSE 

The main task of the college is teaching. It is of first importance that the 
college be continuously informed of the quality of its teaching and the respects 
in which that teaching can be improved. Students are in a position to judge the 
quality of teaching from direct experience, and in order to secure this informa- 
tion, you are asked to rate your instructor on the questionnaire which is attached. 

TO THE STUDENT 

Space is provided on the questionnaire for you to include comments after each 
question. Please make comments that will clarify your rating and/or that will 
help the instructor in improving his teaching. You are asked to sign your eval- 
uation (on this cover sheet which will be detached and turned in separately), but 
the cover sheet with your signature will never be identified with the question- 
naire by the instructor unless your permission has first been obtained by the 
Dean of Instruction. However, the instructor, his Division Chairman and/or the 
Dean of Instruction may review the completed questionnaires (without the cover 
sheets) and the comments you made on them. 



Date 



Course title and section 



I nstructor 



Your signature 
DIRECTIONS 

For each item on the questionnaire that you feel you can answer, circle the place 
on the rating scale which seems to you most appropriate for the instructor you 
are rating. The highest possible rating for an item is 10; the lowest is 0, with 
nine gradations between. To aid you in making your marking, note the three de- 
scriptions for each item — the one at the left for the best rating, the one at 
the right for the poorest rating. 

PLEASE MAKE COMMENTS THAT WILL CLARIFY YOUR RATING IN THE SPACE PROVIDED AFTER 
EACH QUESTION. 
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Questionnaire Code Number 



NORTHAMPTON COUNTY AREA COMMUNITY COLLEGE 
INSTRUCTOR RATING QUESTIONNAIRE 



Date 



Course title and section 



I nstructor 



1. INSTRUCTOR'S KNOWLEDGE < 

10 9 8 7 

Knowledge of subject 
broad and accurate 



SUBJECT 



6 5 4 3 

Knowledge of subject 
somewhat limited 
occasional ly 



2 1 0 
Knowledge of subject 
occas i ona 1 1 y def i c i ent 
or inaccurate 



Comment on whether his knowledge of the subject is up-to-date. . .AND/OR. . .Pin- 
point areas of excellence or weakness. . .AND/OR. . .Comment on the reason for 
your rating: » __ 



2. ORGAN IZATION OF COURSE 

10 .9 8 7 6 5 4 3 2 1 0 

Course exceptionally well Course satisfactorily Organization very poor 

organized. organized 

Cownent on whether the textbooks are particularly appropriate. . .AND/OR. . . 
Comment on whether the course organization aided your note-taki ng. . .AND/OR. . . 
Comment on the reason for your rating: 
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4nst rector* -Rating Scale 



3. ASSIGNMENTS 



10 9 8 7 
Exceptionally clear and 
reasonable; coordinated 
with class work; Imagin- 
ative & we 1 1 -constructed 



6 5 4 3 

Clear, reasonable, 
coord i nated w i th 
class work 
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2 1 0 
Confused or indefinite 
or unrelated to class 
work 



Comment on whether time allowed for assignments was sufficient. . .AND/OR. . . 

Pin-point areas of excellence or weakness. . .AND/OR. . .Comment on the reason 
for your rating: 



4 * ABILITY TO AROUSE INTEREST - SKILL IN GUIDING THE LEARNING PROCESS 

6 5 4 3 2 1 0 

Students seem interested Majority of students 

inattentive most of 
time. 

Comment on the ways he stimulated your thinking or encouraged your partici- 
pation. . .AND/OR. . .Comment on the reason for your rating: 



10 9 8 7 
Interest among students 
usual ly runs high 



5 . CLASSROOM PRESENT ATION! 

6 5 4 3 2 1 0 

Classroom techniques Classroom techniques 

generally effective often inappropriate 

or unski I Iful 

Comment on whether he employs a variety of techniques (lecture, discussion 
demonstration, visual aids) .. .AND/OR. . .Pi n-poi nt areas of excellence or 
weakness AND/OR. . .Comment on the reason for your rating: 



10 9 8 7 

Classroom techniques 
always ski I Iful and 
we 1 1 -chosen 



Instructor Rating Scale 

6. MANNERISMS 
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10 9 8 7 

Mannerisms pleasing 



6 5 4 3 

Mannerisms not 
objectionable 



2 10 
Constantly exhibits 
annoying mannerisms 



Pin-point examples (speech, gestures) worthy of mention* . .AND/OR. . .Comment 
on the reason for your rating: 






7. GRADING 

10 9876543210 

Always fair and impar- Usually fair and Unfair; shows partiality 

tial; makes comments that impartial 
are helpful to student 

Comment on whether the system of grading was made clear to th£ class or 
you rsel f. . .AND/OR. . .Comment on whether the tests adequately covered the 
content of the course. . .AND/OR. . .Exp lain your rating: • 



8. W ILLINGNESS TO HELP 

10 9876543 

Always willing Wi 1 1 ing to help 

to help students students 



2 1 0 
Unwi 1 1 ing to help 
students 



Comment on whether the instructor was available to you. . .AND/OR. . .Comment on 
the reason for your rating: 



Instructor -Rating Scale 

9. SPEECH AND ENUNCIATION 

10 9 8 7 

Speaks clearly and 
distinctly; has varied 
or vivid style 
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6 5 4 3 

Speaks clearly and 
disti nctly 



2 1 0 
Words sometimes Indis- 
tinct and hard to hear 



Pin-point areas of excellence or weakness. . .AND/OR. . .Comment on the reason 
for your rating: 



10. USE OF LANGUAGE 



10 9 8 7 

Uses language carefully; 
improves vocabulary of 
the class. 



6 5 4 3 

Uses language appro- 
priate to the level 
of the class 



2 1 0 
Uses language too 
difficult for the 
class 



Make suggestions. . .AND/OR. . .Comment on the reason for your rating: 



11. GENERAL ESTIMATE OF TEACHER 

10 9 8765432 1 0 

Very superior teacher Average teacher Very poor teacher 

Comment on what advice you would give to a friend who was considering taking 
a course from this instructor. . .AND/OR. . .Comment on the reason for your rating: 



rnstructor Rating Scale Page 5 

12. GENERAL ESTIMATE OF THE COURSE 



10 9 8 7 

One of the most inter- 
esting, informative, use- 
ful, personally helpful 
courses 



6 5 4 3 
About average in inter- 
est, usefulness, etc. 



2 1 0 
One of the least inter- 
esting, informative, 
usef u I , persona 1 1 y 
helpful courses 



Comment on whether you think the course is too difficult for the level 
intended. . .AND/OR. . .Make suggestions. . .AND/OR. . .Comment on the reason for 
your rating: 



UNIVERSITY OF CALIF. 
LOS ANGELES 

□AY 14 1970 

CLEARINGHOUSE FOR 
JUNIOR COLLEGE 
INFORMATION 





